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Abstract 

We define a general product of two n-dimensional tensors A and B with orders m > 2 and k > 1, 
respectively. This product is a generalization of the usual matrix product, and satisfies the associative law. 
Using this product, many concepts and known results of tensors can be simply expressed and/or proved, and 
a number of applications of this product will be given. Using this tensor product and some properties on the 
resultant of a system of homogeneous equations on n variables, we define the similarity and congruence of 
tensors (which are also the generalizations of the corresponding relations for matrices) , and prove that similar 
tensors have the same characteristic polynomials. We study two special kinds of similarity: permutational 
similarity and diagonal similarity, and their applications in the study of the spectra of hypergraphs and 
nonnegative irreducible tensors. We define the direct product of tensors (in matrix case it is also called the 
Kronecker product), and give its applications in the study of the spectra of two kinds of the products of 
hypergraphs. We also give applications of this tensor product in the study of nonnegative tensors, including 
a characterization of primitive tensors, the upper bounds of primitive degrees and the cyclic indices of some 
nonnegative irreducible tensors. 
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1. Introduction 

In recent years, the study of tensors and the spectra of tensors (and hypergraphs) with their various 
applications has attracted much attention and interest, since the work of L.Qi ([12]) and L.H.Lim ([8]) in 
2005. 

As is in [12], an order m dimension n tensor A = (fflij.^— i m )i<*<<n (j=t,— ,m) over the complex field C 
is a multidimensional array with all entries Cbi^—im G C - ,i m G [n] = {1, ••■ ,n\). For a vector 

x = (xi, ■ ■ ■ ,x n ) T G C", let Ax™ 1-1 be a vector in C™ whose ith component is defined as the following: 

n 

(AX ^ ^ J ii2'--im'^i2 ' ' '^im 

and let x" = {x\, ■ ■ ■ ,x r n ) T . Then ([3,12]) a number A G C is called an eigenvalue of A if there exists a 
nonzero vector x G C™ such that 

Kx m - 1 = Ax 1 " 1 " 11 (1.2) 
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and in this case, x is called an eigenvector of A corresponding to the eigenvalue A. L.Qi also defined several 
other types of eigenvalues (and eigenvectors) in [12]. 

Since L.Qi introduced the definitions of various types of the eigenvalues (and eigenvectors) of tensors, 
quite many interesting research works in this area appeared (see [2-5] and [8-15]). But noticing that, the 
term Ax m_1 in the left side of (1.1) is only a special notation (its inside part x" 1 ^ 1 does not have specific 
meaning), and also we can not view the notation Ax" 1-1 as some general operation between A and x" 1-1 . 
Anyway, we have not seen some kinds of general product between tensors up to now. 

In this paper, we will introduce (in Definition 1.1) a general tensor product defined for any two tensors 
of dimension n (one has order m > 2 and another one has order k > 1). We will see that, the product 
of two dimension n tensors is still a tensor of dimension n (but in general will have different order). This 
tensor product also possess many properties. Among them the most important and useful property is the 
associative law (see Theorem 1.1). 

Besides these properties, we can also see that, when the two tensors are matrices (or the first one is a 
matrix and the second one is a vector), our definition of tensor product coincides with the usual matrix 
product, so it is a generalization of the matrix product. 

In this paper, we will also give a number of applications of this tensor product, we will see that, by 
using this tensor product, not only many mathematical expressions can be simplified (for example, the term 
Ax™ -1 in the left side of (1.1) can now be directly simplified as Ax), and many known results can be simply 
stated and proved, but we can also obtain many new results (see sections 2,3 and 4). 

In section 2, we first use this tensor product and some properties on resultant (namely, the hyperdeter- 
minant) to define the similarity of tensors. We prove that the similar tensors have the same characteristic 
polynomials, thus have the same spectrum (as multiset). We also study two special kinds of similarity: per- 
mutation similarity and diagonal similarity. Using the permutation similarity we can show that the spectrum 
of a hypcrgraph is independent of the ordering of its vertices (but the adjacency tensor of a hypcrgraph 
depends on the ordering of its vertices) . Using the diagonal similarity, we obtain a result on the symmetry 
of the spectrum of a nonnegative irreducible tensor which is stronger than the result in [14]. That is: if 
a nonnegative irreducible tensor A has cyclic index k, then the whole spectrum of A is invariant under a 
rotation of angle 2ir/k in the complex plane. We also define in section 2 the congruence relation between 
tensors and apply this relation to the study of E-eigenvalues and E-eigenvectors ([12]). 

In section 3, we generalize the direct product of matrices to the direct product of tensors (of the same 
order, but may be different dimensions). We first prove a relation (Theorem 3.1) between the direct product 
of tensors and the general product of tensors defined in Definition 1.1. Then we use this to study the spectra 
of two kinds of products of hypergraphs. 

In section 4, we apply this tensor product to the study of nonnegative tensors. We give a simple char- 
acterization for the primitivity of a nonnegative tensor in terms of the powers of A. We show that the 
primitivity of a nonnegative tensor A is uniquely determined by the zero pattern of A. From this we show 
the boundedness of the primitive degrees (for fixed n and m) , and give some upper bounds for the primitive 
degrees of the primitive tensors. We also propose a conjecture concerning the upper bound of the primitive 
degrees. 

For the sake of simplicity, we sometime use the following "binary notation" for the subscripts of the 
tensor. Namely, we will write a^i 2 ...i m as a iiai where a = 12 ■ • ■ i m £ [n] m_1 . 
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Now we define the general product of two n-dimcnsional tensors. 

Definition 1.1: Let A (and B) be an order m > 2 (and order k > 1), dimension n tensor, respectively. 
Define the product AB to be the following tensor C of order (to — l)(fc — 1) + 1 and dimension n: 

n 

12,"' i*m = l 

Example 1.1: When fc = 1 and B = x G C™ is a vector of dimension n, then (m — l)(fc — 1) + 1 = 1. Thus 
AB = Ax is still a vector of dimension n, and we have 

n 

(Ax)i = (AB); = q = E a U2 ... im x i2 ■ ■ • x im = (Ax m ~ 1 ) i (where Ax" 1 ^ 1 is defined by (1.2)) 

12,--- ,im = l 

Thus we have Ax™ 1 ^ 1 = Ax. So the first application of the tensor product defined above is that now Ax m ~ x 
can be simply written as Ax. 

Example 1.2: (1). If k = 2 (namely B is a matrix of order n), then (to — l)(fc — 1) + 1 = to. So in this case 
AB is still a tensor of order to. 

(2) . If to = 2 (namely A is a matrix of order n), then (m — l)(fc — 1) + 1 = k. So in this case AB is still a 
tensor of order k. 

(3) . It is easy to check from the definition that I n A = A = A7 n , where /„ is the identity matrix of order n. 

Example 1.3: In case when both A and B are matrices, or when A is a matrix and B is a vector, our tensor 
product AB coincides with the usual matrix product. So it is a generalization of the matrix product. 

Proposition 1.1: The tensor product defined in Definition 1.1 has the following properties. 

(1) . (The left distributivity) : (A : + A 2 )B = A X B + A 2 B. 

(2) . (The right distributivity in the case of to = 2): A(B X + B 2 ) = AB X + AB 2 (when A is a matrix). 
(Note that in general when A is not a matrix, then the right distributivity does not hold.) 

(3) . (AA)B = A(AB). (A e C.) 

(4) . A(AB) = A™- 1 (AB). (A e C.) 

Next we will show that the associative law of this tensor product holds. The following identity will be 
needed in the proof of the associative law. 

m n n m 

II E fu,tji,--- ,t jk )= E n^'** 1 '- ■••*'■*) 

j=l tji,— ,t jk = l t jh = l(l<j<m:l<h<k) j=l 

For the simplicity of the notation, we assume in the following that the tensors A ,B and C have the orders 
m + 1, k + 1 and r + 1, respectively. 

Theorem 1.1 (The associative law of the tensor product): Let A (and B, C) be an order m + 1 (and 
order k + 1, order r + 1), dimension n tensor, respectively. Then we have 

A(BC) = (AB)C 

Proof. For j3\, ■ ■ ■ , j3 m £ ([ n ] r ) k i we write: 

/3i = flu ■■■6-ik, ■■■ , Pm = Omi ■ ■ ■ 9mk (% e [n] r , i = 1, • • • , m; j = 1, • • • , k.) 
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Then we have: 



(A(BC)) ij8l .../? ra - J2 °<*i-*m II( BC )^ft- 

»l,-",»m=l V = 1 

n I m 

»!,■■■ ,i m =l V =1 



m n 



(1.2) 



»l,-"i*m = l \j=l tjl;--- >tjfe = l 

n ri / m 

ii,-,»m=l tih=l(l<J<m;l</i<fe) \j'=l 

where the equation (*) follows from equation (1.1). 
On the other hand, for ai, • • • , a m E [n] k , we write: 

ai = in • • -hk, a m = t m i---t mk {Uj G [n], i = 1, • • • ,ra; j = 1, • • • ,k.) 

Then we also have: 

(m 
Y[(ct jlSjl ■ ■ ■ C tjk g jk ) 
3 = 1 

n n / m \ / m 

X! a Hi-im [Yl b im \ lYl(ct J1 e J1 ---c tjk e Jk )) (1.3) 

t Jfc = l(l<j<m;l</i<fe)ii,-,*m = l \j=l / \j=l 

n n I m 

= Y a «i-*m Y n^'i'-'i'^'j'"'^*) 

,*m = l t j7l = l(l<j<m;l</i<fe) \j=l 

Comparing the right hand sides of (1.2) and (1.3), we obtain A(BC) = (AB)C. □ 

By the associative law, we can henceforth write (AB)C and A(BC) as ABC. We can also define A fe as 
the product of k many tensors A. Furthermore, by the left distributive law and right distributive law for 
matrices, we have: 

P(A + B)Q = PAQ + PMQ (when P, Q arc both matrices) (1.4) 
The unit tensor of order m and dimension n is the tensor I = (Si lt i 2 ,... t i m ) with entries as follows: 



1 if h = ii = ■ ■ ■ = h 
otherwise 



It is easy to see from the definition that Ix = x^ m 1 1. Thus equation (1.2) can be rewritten as 

(AI-A)ar = (1.5) 
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2. The similarity and congruence of tensors 

In this section, we first use the tensor product defined in section 1, together with some properties on 
the resultant of a system of homogeneous equations on n variables, to define the similarity of tensors (which 
is a generalization of the similarity of matrices), and then prove that the similar tensors have the same 
characteristic polynomials, hence the same spectrum (as a multiset). We further study two special kinds of 
similarity: permutation similarity and diagonal similarity, then apply them respectively in the study of the 
spectra of hypergraphs, and in the study of the symmetry of the spectra of nonnegative irreducible tensors. 
We also define the congruence relation between tensors, and show how this relation can be applied in the 
study of E-eigenvalues and E-eigenvectors of tensors ([12]). 

In [6], D.Cox et al used the resultant to define the hyperdeterminant det(A) of a tensor A. 

Definition 2.1 ([6], hyperdeterminant): Let A be an order m dimension n tensor. Then the hyperdeterminant 
of A, denoted by det(A), is the resultant of the system of homogeneous equations Ax = 0, which is also 
the unique polynomial on the entries of A (viewed as independent variables) satisfying the following three 
conditions: 

(1) det(A) = if and only if the system of homogeneous equations Ax = has a nonzero solution. 

(2) detil) = 1, where I is the unit tensor. 

(3) det(A) is an irreducible polynomial on the entries of A, when the entries of A are viewed as independent 
variables. 

The proof of the existence and uniqueness of the polynomial satisfying the above three conditions can be 
found in [7]. 

Definition 2.2: Let A be an order m dimension n tensor. Then the characteristic polynomial of A, denoted 
by </>a(A), is the hyperdeterminant det(XI — A). 

It is easy to see from the above discussions and the equation (1.5) that, A is an eigenvalue of A if and 
only if it is a root of the characteristic polynomial of A. 

In the following study of the similarity and congruence of tensors, we need to use the following formula 
for the entries of the tensor PAQ (where P, Q are both matrices) . 

n 

(PAQ)i 1 ...i m = a j\---j m Vi\j\1nii ' ' ' Qimim (2-1) 

jl,— ,jm = l 

By using the three conditions of the hyperdeterminant in Definition 2.1, we can prove the following lemma. 

Lemma 2.1: Let A be an order m dimension n tensor, I be the order m dimension n unit tensor, P and Q 
are two matrices of order n. Then we have: 

det(PAQ) = det{PlQ)det{A) (2.2) 

Proof. We consider the following two cases. 

Case 1: Both P, Q are invertible. 

Then by the associative law of the tensor product, we can see that Ax = has a nonzero solution x if and 
only if (PAQ)y = has a nonzero solution y, which implies that det(A) = if and only if det(PAQ) = 0. 
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Now by the definition, det(A) is irreducible, so det(A) is a factor of det(PAQ). Similarly, det(PAQ) is a 
factor of det(A) since P, Q are both invertible. Thus there exists some constant c = c(P, Q) (independent of 
A) such that det(PAQ) = c ■ det(A). 

Since c is independent of A, we can take A = I, which gives us that c = det(PIQ), so (2.2) holds in this 
case. 

Case 2: The general case. 

Take P e = P + el and Q e = Q + el. Then P e and Q e can be both invertible when e is in some small open 
interval (0,5). Thus by Case 1 we have 

det(P e AQ e ) = det(P e lQ e )det(A) (ee(0,5)) (2.3) 

Take the limit e->0on both sides of (2.3), we obtain (2.2). □ 

Definition 2.3: Let A and B be two order m dimension n tensors. Suppose that there exist two matrices P 
and Q of order n with PIQ = I such that B = PAQ, then we say that the two tensors A and B are similar. 

Remark 2.1: If P and Q are two matrices of order n with PIQ = I, where I is the order m dimension n 
unit tensor, then both P and Q are invertible matrices. 

Proof. (1). If Q is not invertible, then there exists some nonzero vector x £ C™ such that Qx = 0. Thus 
by the associative law of the tensor product we have x^ m ~^ = la; = PIQx = 0, which implies that x = 0, a 
contradiction. 

(2). If P is not invertible, then there exists some nonzero vector y G C™ such that Py = 0. Now take 
x = Q~ 1 y lm ~ 1 ^ , then a; is a nonzero vector since y is. But then we would have x' im ^ 1 ^ = Ix = PIQx = 
piy[ m -il = py = o, which implies that x — 0, a contradiction. □ 

Remark 2.2: The similarity relation of tensors is an equivalent relation. 

Proof. The reflection follows from I n AI n = A (where /„ is the identity matrix) . The symmetry follows from 
Remark 2.1 and the associative law of the tensor product. The transitivity also follows from the associative 
law of the tensor product. 

The following theorem shows that similar tensors have the same characteristic polynomials, and thus they 
have the same spectrum (as a multiset). 

Theorem 2.1: Let A and B be two order m dimension n similar tensors. Then we have: 

(1) . det(M) = det(A). 

(2) . 0b(A) - A (A). 

Proof. By definition, there exist two matrices P and Q of order n with PIQ = I and B = PAQ. Then (1) 
follows directly from Lemma 2.1. 

For (2), by using the equation (1.4) and the relations PIQ = I and B = PAQ, we have 

P(AI - A)Q = XPIQ - PAQ = XI - B 

Thus AI — A and AI — B are also similar. Using this and the result (1) of this theorem we have 

B (A) = det{XI - B) = dei(AI - A) = A (A). 

□ 

In the following, we consider two special kinds of the similarity of tensors. The first one is the permutation 
similarity of tensors, and the second one is the diagonal similarity of tensors (also see [14,15]). 
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Lemma 2.2: Let a £ S n be a permutation on the set [n], P = P a = (p^) be the corresponding permutation 
matrix of a (where pij = 1 j = cr{i)). Let A and B be two order m dimension n tensors with B = PAP T . 
Then we have: 
(!)• bi 1 ...i m — a -(j 1 )... -(j m ). 

(2). PIP T = I. (Thus A and B are similar.) 
Proof. (1) By using the formula (2.1) we have: 

n n 
l>ii---i m = a ji---j m Piiji((P )j2i2 ' ' ' (P )j m im) = a jl---jmPiljlPi2j2 ''' Pi m j m — a c(ii)---<y(i m ) 

jl,---,jm = l jl,---,jm = l 

(2). From (1) we see that the diagonal elements of B are those diagonal elements of A, and the non-diagonal 
elements of B are those non-diagonal elements of A. Thus we have B = I when A = I. Namely PIP T = I. □ 

From (2) of Lemma 2.2, we see that if P = P a is a permutation matrix, A and B are two order m 
dimension n tensors with B = PAP T , then A and B are similar tensors. In this case we say that A and B 
are permutational similar. 

It is easy to see that if A and B arc permutational similar, and A is supersymmetric, then B is also 
supersymmetric. 

An important application of the permutational similar tensors is on the spectra of hypergraphs. According 
to the definition, the spectrum of a hypergraph is the spectrum of its adjacency tensor. But the adjacency 
tensor of a hypergraph depends on the ordering of its vertices. Thus a natural question arises: Is the spectrum 
of a hypergraph independent of the ordering of its vertices? 

By using the permutational similar tensors, it is easy to see that if we have two different orderings of 
the vertices of a hypergraph, then the two adjacency tensors are permutational similar. Since permutational 
similar tensors have the same spectra (by Theorem 2.1), we can now obtain an affirmative answer to the 
above question: 

Theorem 2.2: (1). The spectrum (as a multiset) of a hypergraph is independent of the ordering of its 
vertices. 

(2). Isomorphic hypergraphs have the same spectra. □ 

Now we consider the second special kind of similarity of tensors: the diagonal similarity. This relation 
of tensors was first studied in [14] and [15], and was applied to the study of the spectra of nonnegative 
irreducible tensors. Here we use our tensor product to show that, this relation between tensors is also a 
special kind of similarity in the sense of Definition 2.3. 

Lemma 2.3: Let D = diag(dn, ■ ■ ■ ,d nn ) be an invertible diagonal matrix of order n. Then we have 

D -(m-l) ID = L 

Proof. By using the formula (2.1) we have 

n n 

m-( m - 1 )iDV ■ - \ " a . rn~( m_1 )v d d ■ — s ^(n~ {m ~ 1) \- d d - — s- ■ 

□ 
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Definition 2.4: Let A and B be two order m dimension n tensors. We say that A and B are diagonal similar, 
if there exists some invertible diagonal matrix D of order n such that B = D~( m ~ 1 )AD. 

Theorem 2.3: If the two order m dimension n tensors A and B are diagonal similar, Then 0b(A) = </>a(A). 
Proof. From Lemma 2.3 we see that diagonal similar tensors are similar. □ 

Using Theorem 2.3, we can obtain the following result (which is stronger than a related result in [14]) on 
the symmetry of the spectrum of a nonnegative irreducible tensor. 

Theorem 2.4: Let A be an order m dimension n nonnegative irreducible tensor with the spectral radius 
p(A). Suppose that the cyclic index of A is k (namely, A has exactly k distinct eigenvalues with modulus 
p(A)). Then spec(A) (as a multiset) is invariant under a rotation of an angle ^ on the complex plane, and 
therefore </>a(A) = A r /(A fe ) for some nonnegative integer r and some polynomial f(x). 

Proof. By [14], there exists an invertible diagonal matrix D, such that 

K = e- 2 -T ± D- {m -^KD. 

So from Theorem 2.2 we have spec(A) = e~ -™ spec(D-( m -V AD) = e k spec{A). 
Now suppose that 

d 

^a(A) = ^ aj\ d ~\ (where d is the degree of 0a (A)) 

3=0 

Then from the above result we have 

d d 

e^~>A(A) = 0A(e"^A), and thus ajX d ~ j = ^ aj(e~^ X) d ~ 3 

j=o j=0 

Comparing the coefficients of both sides, we obtain e * aj = e *= aj. Thus a 3 - — if j is not a multiple 
of k. Therefore we have A (A) = A r /(A fe ). □ 

In [14] and [15], Q.Yang and Y.Yang give the following results regarding the diagonal similar tensors. Here 
we show that the proofs of these results can be simplified by using the associativity of our tensor product. 

Theorem 2.5 ([14] and [15]) : (1). Suppose that the two tensors A and B are diagonal similar, namely 
1 = D-( m ~VAD for some invertible diagonal matrix D. Then x is an eigenvector of B corresponding to the 
eigenvalue A if and only if y = Dx is an eigenvector of A corresponding to the same eigenvalue A. 

(2). Every nonnegative irreducible tensor A is diagonal similar to a multiple of some stochastic tensor. 

Proof : (1). By the associative law of the tensor product, we have for y = Dx that 

Mx = \x^ 1 -^ <^=> D- {m -^ADx = Axl" 1 - 1 ! <j=> Ay = D {m -^ Xx^^ = \{Dx)^ m -^ Ay = Xy^" 1 ^ 

(2). Let u be the positive eigenvector of A corresponding to the eigenvalue p(A). Let e be the column 
vector of dimension n with all components 1, let D be the invertible diagonal matrix with u = De, and 
let B = D-^-^AD. Then B is also nonnegative. So from the result (1) and Am = p(A)u^ m ^ 1 \ we have 
Be = p(A)e[ m_1 ] = p(A)e, which means that ^pjB is a stochastic tensor. □ 

Now we consider another relation between tensors: the congruence relation (which is also a generalization 
of the congruence relation between matrices) and its applications on the E-eigenvalues and E-eigenvectors of 
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tensors. First we recall that in [12, section 6], L.Qi defined a useful relation between tensors (which he called 
"orthogonal similarity") as follows. 

Definition 2.5 (L.Qi, 2005 [12]): Let P = (pij) be a matrix of order n, A and B be two order m dimension 
n tensors. If the elements of A and B satisfy the following relation: 

n 

bii-"im = y ] a ji ■■■jm.PhjlPizh ' ' ' Pimjm ■ 
3u— >im=l 

Then it is written as B = P m A. In the case when P is a real orthogonal matrix, then A and B are called 
" orthogonal similar" . 

Remark 2.3: (1) By using the tensor product defined in section 1 and the formula (2.1), we see that 
the relation B = P m A defined above is actually the same as the tensor relation B = PAP T . Since the 
corresponding relation for matrices is called the "congruence relation", so in this paper we choose to call 
the two tensors A and B to be congruent if B = PAP T for some matrix P. In the case when P is a real 
orthogonal matrix, then we call A and B as " orthogonal congruent" . 

(2) Notice that when P is a real orthogonal matrix, the relation PIP T = I does not necessarily hold. That 
is to say, PAP T and A are not necessary similar in the sense of our Definition 2.3. This is another reason 
why in this paper we choose to call them "orthogonal congruent" instead of "orthogonal similar". □ 

It is easy to see that the orthogonal congruence relation is also an equivalent relation between tensors. 

In [12, Theorem 7], L.Qi also proved the following result about the E-eigenvalues and E-eigenvectors of 
tensors, which can now be simply stated and proved as the following, by using our tensor product and its 
associative law. 

Theorem 2.6 : Suppose that the two tensors A and B are "orthogonal congruent", namely B = PAP T for 
some real orthogonal matrix P. Then x is an E-eigenvector of A corresponding to the E-eigenvalue A if and 
only if y = Px is an E-eigenvector of B corresponding to the E-eigenvalue A. 

Proof : Since y T y — x T x for y — Px, it is obvious that x T x = 1 if and only if y T y — 1. Also, by the 
associative law of the tensor product, we have 

My = \y ^> (PAP T )(Px) = X(Px) <^ P(Ax) = P(Xx) ^ Ax = \x 



3. The direct product A® 1 of tensors with applications on the spectra of products of hyper- 
graphs 

It is well-known that the direct product of matrices (denoted by (g>) is a useful concept and tool in matrix 
theory. It has many applications in various fields, including the applications in the study of the spectra of 
products of graphs. In this section, we will show that the concept of the direct product of matrices can be 
generalized to tensors, and can also be applied to the study of the spectrum of the products of hypergraphs. 

Definition 3.1: Let A and B be two order k tensors with dimension n and m, respectively. Define the direct 
product A (g) B to be the following tensor of order k and dimension nm (the set of subscripts is taken as 
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[n] x [m] in the lexicographic order): 

(A (g> B)(j 1 ,ji)(t2,j 2 ) — (»* J'fc) = a ili2---ik^jlh---ik 



From this definition it is easy to see the following proposition. 
Proposition 3.1: 

(1) . (Ai + A 2 ) <8> 1 = Ai (g) 1 + A 2 <g> B. 

(2) . A (Bi + B 2 ) = A ® Bi + A ® B 2 . 

(3) . (AA) ® B = A ® (AB) = A(A ® B). (A G C.) 

The following theorem gives an important relation between the direct product of tensors and the general 
product of tensors defined in section 1, which is also a generalization of the corresponding relation for matrices. 

Theorem 3.1: Let A and B be two order k + 1 tensors with dimension n and m, respectively. Let C and B 
be two order r + 1 tensors with dimension n and m, respectively. Then we have: 



(A<g>B)(C<S>B) = (AC)C 
Proof. For the simplicity of notation, we write 

(a,/3) = ((oi,6i),-- • , (a r ,b r )) G ([n] x [m]) r , (if a = (a lr - ■ ,a r ) G [n\ r , f3 = {b x , ■ ■ ■ ,b r ) G [m] r ). 
In the following, we assume G [n] r , /3j G [»n] r , = 1, • • • , fc). Then by Definition 1.1 we have 
((A®B)(C®D)) (lj)(QiA) ... (QfcA) 

X) ( A ® B )(«)(H.Ji)-(4,j fc )( C ® HtyiijiXaLft) ■ ■ • (C ® B)( 4fc , Jfc )(a fe ,^) 

(*i,ji)r" i(»fcijfc)e[n]x[m] 
n m 

= ^ ] ^ ' a iii---i k bjji---j k (Ci iai dj 1 p 1 ) • • • {Ci k a k dj k p k ) 

H,-" i»*=l Jli--- Jfc = l 

n \ / m 

X! a iil---ife C ilQ!l ' ' ' c ifeQ!fe J I X/ bjj 1 ...j k dj 1 fj 1 ■ ■ ■ dj k p k 
.»!,■■■ ,i fc =l / \ji,-"ijfc=l 



= ((AC)®(BB)) (ii . )(ai>/3i) ... (afcA) 

Thus we have (A <g> B)(C B) = (AC) ® (BD). □ 

Now we consider the applications of the direct product of tensors in the study of the spectra of the 
products of hypergraphs. 

Definition 3.2 ([5], The Cartesian product of hypergraphs): Let G and H be two hypergraphs. Define the 
Cartesian product GUH of G and H as: V{GUH) = V(G) x V(H), and {(*i, ji), • • • , (v, >)} G E(GOH) if 
and only if one of the following two conditions holds: 

(1) . ii = • • • = i r and {ji, • • • , j r } G 

(2) . .n = ---= i r and {i u ■ ■ ■ ,i r } G £(G). 



10 



A hypergraph H = (V, E) is called fc-uniform if every edge of H is a subset of V with fc elements. The 
adjacency tensor of H (under certain ordering of vertices) is the order fc dimension n tensor Ah with the 
entries ([5]) 

= f p^T)T it {h,i2,--- ,h} €E(H) 
1 otherwise 
The characteristic polynomial and spectrum of a uniform hypergraph H are that of its adjacency tensor. 

Using the direct product of tensors, the adjacency tensor of the Cartesian product of fc-uniform hyper- 
graphs can be expressed as in the following theorem. 

Theorem 3.2: Let A and B be the adjacency tensors of a fc-uniform hypergraph G of order n and a fc- 
uniform hypergraph H of order to, respectively. Then the adjacency tensor of GOH is A ® l m + I„ ® B 
(where the ordering of the vertices of GOH is taken to be the lexicographic ordering of the elements of the 
set V(G) x V(H)). 

Proof. Let C be the adjacency tensor of the hypergraph GUH. Then by definition we can check that: 



b h ... jk if i 1= i 2 = --- = i k 

if h = .h = ■■■ =jk (3-1) 
otherwise 

Notice that all the diagonal entries of A and B are zero, so it follows from (3.1) that 

It is also easy to see that 

(A®I m +I„ 8B) (ilijl) ... (itiji) = ail ... lk S n ... jk +<5i 1 ...i fc 6j 1 ...j fe 
So we have C = A ® I m + I„ ® B. □ 
Now we consider another kind of product of the hypergraphs. 

Definition 3.3 (The direct product of hypergraphs): Let G and H be two hypergraphs. Define the direct 
product G x H of G and H as: V(G x H) = V(G) x V(fl"), and {(ii, ji), • • • , (*r,>)} G E(G x ^) if and 
only if {ii, •■• ,i r } S .5(G) and {j u ■ ■ ■ ,j r } G S(fl'). 

Using the direct product of tensors, the adjacency tensor of the direct product of fc-uniform hypergraphs 
can be easily obtained as in the following theorem. 

Theorem 3.3: Let A and B be the adjacency tensors of a fc-uniform hypergraph G of order n and a fc- 
uniform hypergraph H of order to, respectively. Then the adjacency tensor of G x H is (fc — 1)!(A <g> B) 
(where the ordering of the vertices of G x H is taken to be the lexicographic ordering of the elements of the 
set V(G) x V{H)). 

Proof. Let C be the adjacency tensor of the hypergraph G x H. Then by definition we can check that 



prziji if a h---ik an( f ^ji—jk are both nonzero 
otherwise 



C (h,ji) — (ikJk) ~ 

Thus it follows that 

c (iuji)-(ik,jk) = = ( fc - 1 ) ! (A®B) (4lJl) ... (lfciifc) 
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So we have C = (k - 1)!(A <g> B). □ 

The following theorem gives the relation between the eigenvalue-eigenvectors of the tensors A and B and 
that of A ® B and A ® l m + I„ ® B. 

Theorem 3.4: Let A and B be two order k tensors with dimension n and to, respectively. Suppose that we 
have Au = Ait^ -1 ! , and Rv = uu^ -1 ! , and we also write w = u <S> v. Then we have: 

(1) . (A ® l m + 1„ ® B)w = (A + . 

(2) . (A®B)w = (Xnjw^- 1 }. 

Proof. We have by Proposition 3.1 and Theorem 3.1 that: 
(!)■ 

(A <g> I m + I„ <g> B)w = (A <g> I m + I„ <g> B)(u ® u) = (Au) <g> (I m w) + (I„u) <g> (Bu) 
= (A + ^(ul*- 1 ! ® t^- 1 !) = (A + /*)(« ® v) [fe - 1] = (A + M ) W I' S - 1 ] 

(2). 

(A ® B)to = (A ® B)(u ® w) = (Au) ® (B«) = (Au [ ^ 1] ) ® (fiv [k ~ 1] ) 
= (AM)(M [fe_11 ®^ [fc - 1] ) = (Am) (u®v) 1/5-11 = (Am)w [/s " 1] . 

□ 

From Theorem 3.4, we can obtain the following results about the spectra of the hypergraphs GUH and 
G x H, where the result on the spectrum of GOH was obtained by Cooper and Dutle in [5], but by using 
the direct product of tensors defined here, our Theorem 3.4 actually gives a simplified proof of that result on 
the spectrum of GOH. 

Theorem 3.5: Let G and H be two fc-uniform hypergraphs. Let A be an eigenvalue of G with corresponding 
eigenvector u, and fi be an eigenvalue of H with corresponding eigenvector v, respectively. Then we have: 

(1) . ([5]) A + u is an eigenvalue of GOH with corresponding eigenvector u<3v. 

(2) . Au is an eigenvalue of G x H with corresponding eigenvector u <S> v. □ 



4. Applications in the study of nonnegative tensors 

In [2] and [4], Chang et al studied the properties of the spectra of nonnegative tensors. They defined 
the irreducibility of tensors, and the primitivity of nonnegative tensors (also see [11]), and extended the 
well-known Perron-Frobenius Theorem from the nonnegative irreducible matrices to nonnegative irreducible 
tensors. They also extended many important properties of primitive matrices to primitive tensors. In [14] 
and [15], Q.Yang and Y.Yang gave some further results on the generalizations of Perron-Frobenius Theorem, 
including some results on the symmetry of the spectra of nonnegative irreducible tensors. 

In this section, we will give some applications of the tensor product in the study of nonnegative tensors, 
especially in the study of primitive tensors. Among these applications, we will give a simple characterization 
of the primitive tensors in terms of the zero patterns of the powers of A (in the sense of the tensor product 
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defined in section 1), and give some upper bounds for the primitive degrees of the primitive tensors. We also 
give some result on the cyclic index of a nonnegative irreducible tensor. 

Let Z(A) be the tensor obtained by replacing all the nonzero entries of A by one. Then Z(A) is called 
the zero-nonzero pattern of A (or simply the zero pattern of A). 

First we have the following result on the zero patterns of the products of two nonnegative tensors. 

Lemma 4.1: The zero pattern of the product AM of two nonnegative tensors A and B is uniquely determined 
by the zero patterns of A and B. 

Proof. Suppose that Z(Ai) = Z(A 2 ) and Z(M>i) = Z(M 2 ). Then there exist positive numbers Ci,c 2 ,Mi 
and M 2 such that 

C1A1 < A 2 < M1A1; c 2 Bi < B 2 < M 2 Bi 

From this it follows that Cic™" 1 A x Bi < A 2 B 2 < MiM™ _1 AiBi (where m is the order of Ai). Thus we have 
Z(AiBi) = Z(A 2 B 2 ). □ 

The following result will be used in Definition 4.1. 

Proposition 4.1: Let A be an order in dimension n nonnegative tensor. Then the following three conditions 
are equivalent: 

(1) . For any i 7 j G [n], a%j---j > holds. 

(2) . For any j G [n], Aej > holds (where is the j th column of the identity matrix /„). 

(3) . For any nonnegative nonzero vector x G W 1 , Ax > holds. 

The proof of this proposition is straightforward. □ 

Definition 4.1 (Pearson, [10]): A nonnegative tensor A is called essentially positive, if it satisfies one of the 
three conditions in Proposition 4.1. 

In [4] and [11], Chang et al and Pearson define the primitive tensors as follows. 

Definition 4.2 ([4] and [11]): Let A be a nonnegative tensor with order m and dimension n. Define the map 
Ta from W l to R™ as: T&(x) — (Aa;)'"» =T ^ (here Ax is understood as the tensor product defined in section 1). 
If there exists some positive integer r such that T^(x) > for all nonnegative nonzero vectors x G K™, then 
A is called primitive, and the smallest such integer r is called the primitive degree of A, denoted by 7(A). 

By using the properties of tensor product and Lemma 4.1, we can obtain the following simple character- 
ization for primitive tensors. 

Theorem 4.1: A nonnegative tensor A is primitive if and only if there exists some positive integer r such 
that A r is essentially positive. Furthermore, the smallest such r is the primitive degree of A. 

Proof: For convenience, here we use the notation A i2 B to denote that A and B have the same zero pattern. 

We first use induction on r to show that for any nonnegative nonzero vectors x G M™, T^(x) and A r x 
have the same zero pattern. When r — 1, we obviously have T^(x) = (Ax)^ m -^ ^ Ax. In general, by the 
inductive hypothesis, Lemma 4.1 and the associative law of the tensor product we have: 

Tl(x) = T A (Tl-\x)) = (AT;- 1 ^))^] - ATI-^x) - A(A- 1 x) = A*x. 

From this we have for any nonzero vector x > and positive integer r that: T^(x) > <i=^ A r x > 0. 
Thus our result follows directly. □ 
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Using the similar ideas, the characterization of (nonnegative) irreducible tensors given in [15, Theorem 
5.2] can also be simply stated as: A nonnegative tensor A of dimension n is irreducible if and only if (A+I)™ -1 
is essentially positive. 

The following Lemma 4.2 will be used in the proof of Theorem 4.2. 

Lemma 4.2: Let A be a nonnegative tensor. If A r is essentially positive, then A r+1 is also essentially 
positive. 

Proof: By hypothesis, A r x > for all nonzero vectors x > 0. It follows that y = Ax is also a nonzero 
(nonnegative) vector (otherwise we will have A r x = 0). Therefore we have (for any nonzero vectors x > 0) 
that: A r+1 a; = A r (Ax) = A r y > 0, so A r+1 is essentially positive. □ 

The following theorem shows that, although there are infinitely many primitive tensors of order m and 
dimension n, their primitive degrees are bounded above and have the following upper bound. 

Theorem 4.2 (An upper bound of the primitive degrees): Let A be a nonnegative primitive tensor with 
order m and dimension n. Then its primitive degree 7(A) < 2™ . 

Proof: First we notice that there are altogether 2™ many different zero patterns for order m dimension n 
tensors. So among the powers A, • • • , A 2 " +1 , there must be some two powers having the same zero pattern. 
Thus there exist some integer k < 2""* and some integer p > such that Z(A k ) = Z(A k+p ). From this it will 
follow by Lemma 4.1 that Z(A k ) = Z(A k+tp ) for all nonnegative integers t. On the other hand, by Lemma 
4.2 we also know that A k+tp is essentially positive for all sufficiently large t, so A k is essentially positive, 
which implies by definition that 7(A) < k < 2™ . □ 

Remark 4.1: The upper bound 2 n can be replaced by the number of different zero patterns of all the 
primitive tensors of order m and dimension n. Thus the upper bound in Theorem 4.2 is not sharp. □ 

In [10], Pearson defined the majorization matrix M(A) of a tensor A as the following: 



Pearson ([10]) also proved that if M(A) is an irreducible matrix, then A is also irreducible. 

Also, the spectral radius of A is denoted by p(A), and the cyclic index of a nonnegative irreducible tensor 
A is defined to be the number of distinct eigenvalues of A whose absolute value is p(A). 

In the following theorem, we use the majorization matrix M(A) to study the cyclic index of a nonnegative 
tensor A. 

Theorem 4.3: Let A be a nonnegative tensor with order m and dimension n. If the matrix M(A) is 
irreducible, then the cyclic index of M(A) is a multiple of the cyclic index of A. 

Proof: By ([10]) we know that A is also irreducible. Now let k be the cyclic index of A, and p be the cyclic 
index of the irreducible matrix M(A). If k = 1, the result holds obviously. So we assume that k > 2. 

Let A = p(A)e l27T / k , let y = (j/i, • • ■ , y n ) T be an eigenvector of A (with full support) corresponding to the 
eigenvalue A, and write (as in [4]) 



(M(A))y = 



•ij—j 



n) 



(i = i 
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Then by [4, Lemma 4.4], we have for any a^...^ > that 

<f>i 2 + h <pi m — (in — l)^! - | eZ (Z is the set of all integers) (4.1) 

Let j\ ■ ■ -j r ji be a (directed) cycle of the associated digraph D(M(A)) ([1]) of the matrix M(A) (with 
length r), then we have 

(M(A)) jtjt+1 > (i = 1,- • • ,r, mod r) => a jtjt+1 ... jt+1 > (t = 1,- • • ,r, mod r) 

=> (m - l)<(>j t+1 - (m - l)<^ t - ^ G Z (t = 1, • • • , r, mod r) 

Adding the above r relations together, we obtain 

r 

(™-i)Efc +1 -fc)-: = l eZ (42) 
t=i 

Thus fc divides r. But r is an arbitrary cycle length of the associated digraph of the matrix M(A), so k 
divides the greatest common divisor of all the cycle lengths of the associated digraph of M(A), which is just 
p, the cyclic index of the irreducible matrix M(A) ([1]). □ 

We also have the following relation between the primitive degrees of A and M (A). 

Corollary 4.1: Let A be a nonnegative tensor with order m and dimension n. If M(A) is primitive, then A 
is also primitive and in this case, we have 7(A) < r y(M(A)) < (n — l) 2 + 1. 

Proof: 7(M(A)) < (n — l) 2 + 1 is the well-known Wielandt's upper bound for primitive matrices ([16]). So 
we only need to show that A is primitive and 7(A) < 7(M(A)). For this purpose, we use the notation A £ B 
to denote (the zero patterns) Z(A) > Z(M). Then we first prove for two nonnegative tensors A and B that 
M(AB) >z M(A)M(B). For if (M(A)M(B))^ > 0, then there exists h e [n] such that (M(k)) lh > and 
(M(M))hj > 0. It means that dih—h > and bhj-.-j > 0, which implies that 

n 

(M(AB))ij = (AM)ij...j = «»•,•••<„. • • • h,.i-i > a ih ... h (b hJ ...jY l 1 > 0. 

Now from M(AB) ^ M(A)M(B) we can see that for any integer k > 0, we have M(A fc ) ^ (M(A)) fc . Take 
k = 7(M(A)), then we have M(A k ) >z (M(A)) k > 0, which means that A k is essentially positive. So A is 
also primitive and 7(A) < k — -f(M(Aj). □ 

Now we propose the following conjecture on the primitive degrees. 

Conjecture 1: When m is fixed, then there exists some polynomial /(n) on n such that 7(A) < f(n) for all 
nonnegative primitive tensors of order m and dimension n. 

In the case of m = 2 (A is a matrix), the Wielandt's upper bound tells us that we can take /(n) = 
(n-l) 2 + l. 

Definition 4.3: Let A be a nonnegative tensor with order m and dimension n. If there exists some positive 
integer k such that A fe > is a positive tensor, then A is called strongly primitive, and the smallest such k 
is called the strongly primitive degree of A. 
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It is obvious that the strong primitivity implies the primitivity. Also, in the matrix case (m = 2), it is 
well-known ([1]) that a nonnegative matrix A is primitive if and only if it is strongly primitive. But the 
following example shows that these two concepts are not equivalent in the case m > 3. 

Example 4.1: Let A be a nonnegative tensor of order m > 3 and dimension n, and with 

_ | 1 if i 2 = ■ ■ ■ = i m 
l1 * 2 lm I otherwise 

Then A is a primitive tensor, but not a strongly primitive tensor. 

Proof: A is primitive since A itself is already essentially positive. Now we use induction on k to show that 
if i2 7^ h, then (A k )i li2 i 3 ... ir — (where r = (m — l) k + 1). 

If k = 1, the result follows from the definition of A. In general when k > 2, let B = A fc_1 = {bj 1 ...j t ), 
where t = (m — l) fe_1 + 1. Then by the inductive hypothesis, we have bj 1 i 2 i 3 ...j t = when i 2 ^ h- Therefore 
we have 

n 

(A )i 1 i 2 i 3 ---i r — (A®)iii 2 i3---ir = ^ ' a iiji---jm-i^iii2i3---it^j2H+i---i2t-i ^jm-iir-t+2---i r = ^ (*2 ^ *3) 

Jl,-" >jm-l = l 

Thus A fc is not a positive tensor for all integers fc, so A is not strongly primitive. □ 
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